On the complexity of strong Nash equilibrium: 
Hard-to-solve instances and smoothed complexity 
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Abstract 

The computational characterization of game- 
theoretic solution concepts is a central topic in arti- 
ficial intelligence, with the aim of developing com- 
putationally efficient tools for finding optimal ways 
to behave in strategic interactions. The central so- 
lution concept in game theory is Nash equilibrium 
(NE). However, it fails to capture the possibility 
that agents can form coalitions (even in the 2-agent 
case). Strong Nash equilibrium (SNE) refines NE 
to this setting. It is known that finding an SNE is 
TVAT'-complete when the number of agents is con- 
stant. This hardness is solely due to the existence 
of mixed-strategy SNEs, given that the problem of 
enumerating all pure-strategy SNEs is trivially in 
V. Our central result is that, in order for a game 
to have at least one non-pure-strategy SNE, the 
agents' payoffs restricted to the agents' supports 
must, in the case of 2 agents, lie on the same line, 
and, in the case of n agents, lie on an (n — 1)- 
dimensional hyperplane. Leveraging this result, we 
provide two contributions. First, we develop worst- 
case instances for support-enumeration algorithms. 
These instances have only one SNE and the support 
size can be chosen to be of any size — in particular, 
arbitrarily large. Second, we prove that, unlike NE, 
finding an SNE is in smoothed polynomial time: 
generic game instances (i.e., all instances except 
knife-edge cases) have only pure-strategy SNEs. 

1 Introduction 

The computational characterization of game-theoretic solu- 
tion concepts is a central topic in artificial intelligence, with 
the aim of developing computationally efficient tools for find- 
ing optimal ways to behave in strategic interactions. The 
central solution concept provided by game theory is Nash 
equilibrium (NE). Every finite game admits at least one NE 
in mixed strategies. Computer scientists have characterized 
the complexity of NE finding and provided a number of al- 
gorithms. Finding an NE of a strategic-form (aka normal- 
form) game is P'P^X'-complete iDaskal Scis et al., 2006| 
even with just two agents I Chen et ai, 2009 1 . Such games are 
called bimatrix games. Although WAD C AfV, it is gen- 
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erally believed that WAV ^ V and therefore that there not 
exists any polynomial-time algorithm to find an NE unless 

V = NV. Furthermore, bimatrix games do not have a fully 
polynomial-time approximation scheme unless WAV C 

V i Chen et al, 2009J and finding an NE in bimatrix games is 
not in smoothed-'P unless WAV C TIV | |Chenef al, 2006) 
and, therefore, by definition of smoothed complexity, game 
instances remain hard even if subjected to small pertur- 
bations. Instances |Savani and von Stengel, 2006| that re- 
quire exponential time when solved with a number of 
algorithms jLemke and Howson, I964t [Porter et al, 2009) 
are known. (However, these instances are unstable: 
they become easy when small perturbations are ap- 
pUed |Gattiefa/.,20T2) .) 

NE captures the situation in which no agent can gain 
more by unilaterally changing her strategy. When agents 
can form coalitions and change their strategies multilaterally 
in a coordinated way, the most natural solution concept is 
strong Nash equilibrium (SNE) |Aumann, I960| . An SNE 
is a strategy profile from which no coalition can deviate in a 
way that benefits each of the deviators. SNE has significantly 
different properties than NE. An SNE is not assured to exist. 
Finding an SNE (determining if one exists) is A/^T'-complete 
when the number of agents is constant; TVAT'-hardness was 
proven in I Coni tzer and Sandholm, 2008 1 and membership 
in MV in [Gatti etal.,2Q\3\ . Unhke for NE, the literature 
has very few algorithms for SNE. There are algorithms for 
finding pure-strategy SNEs for specific classes of games, 
e.g., congestion games ||Holzman and Law- Yone, 1997 
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Hoefer and Skopahk, 2010), 

tion games [[Epstein et al., 2007) , 

games I'Gourves and Monnot, 20091, and 
games [ Nessah and Tian, 2012 1. However, the hardness 
in the general setting is due to the existence of mixed- 
strategy SNEs, given that the pure-strategy ones can be 
found in polynomial time by combining support enu- 
meration and verification. The only prior SNE-finding 
algorithm that works also for mixed strategies is only 
for 2-agent games [ [Gatti et al, 2013) . Its application 
to instances from the ubiquitous NE benchmark testbed, 
GAMUT [ [Nudelmanef g/. , 20041, shows that these instances 
either admit pure SNEs or do not admit any SNE and 
therefore that new benchmark testbeds for SNE-finding 



algorithms are needed. 

In this paper, we provide the following main contributions. 

• We show that, if there is a mixed-strategy SNE, then the 
payoffs restricted to the actions in the support must sat- 
isfy specific conditions. For example, in 2-agent games, 
they must lie on the same line in agents' utilities space. 

• We show how to generate 2-agent games with m actions 
per agent, only one SNE, and any desired number of ac- 
tions {1, . . . , ^} in the support of each agent's mixed 
strategy. These are the worst-case instances for support- 
enumeration algorithms, requiring time 0(4^). 

• We show that, for any number of agents, finding an 
SNE is in smoothed-P, thus admitting a deterministic 
support-enumeration algorithm with smoothed polyno- 
mial running time. In the generic case (i.e., in all except 
knife-edge cases), all SNEs are pure. 

Preliminaries 

strategic-form game is a tuple {N, A, U) 



2 
A 
where |Shoham and Ley ton-Brown, 2008 1: 

• N = {1, . . . , n} is the set of agents (we denote by i a 
generic agent), 

• A — {Ai, . . . , An} is the set of agents' actions and Ai 
is the set of agent i's actions (we denote a generic action 
by a, and by nii the number of actions in Ai), 

• U = {Ui . . . , Un} is the set of agents' utility arrays 
where Ui{ai, . . . , an) is agent i's utility when the agents 
play actions ai, . . . , a„. 

We denote by Xi{ai) the probability with which agent i plays 
action ai G Ai and by Xi the vector of probabilities Xi{ai) of 
agent i. We denote by A^ the space of well-defined probabil- 
ity vectors over Ai. We denote by Si the support of agent i, 
that is, the set of actions played with positive probability, and 
by S the support profile {Si,. . . ,Sn)- 

The most central solution concept in game theory is NE. A 
strategy profile x = (xi, . . . , x„) is an NE if, for each i £ 
N, ^fU, n,^. x_, > xf f/, Uj^^ x_, for every x^ e A,. 
Every finite game admits at least one NE in mixed strategies. 
The problem of finding an NE can be expressed as: 






Ui{ai,a-i)- Y[ Xj{aj)>0 Vi S -/V, a; G 



(1) 



jeJV: 



Xi(ai) ■ 



E t/.(«. 






Y[ Xj{aj) ] = yi & N,ai € Ai (2) 



Xi{ai}>0 \/i e N,ai e Ai (3) 



Vie N (4) 



J2 ^.K) = i 



ai^^i 



Here Vi is the expected utility of agent i. Constraints ^ force 
the expected utility Vi to be non-smaller than the expected 
utility given by every action a^ available to agent i. Con- 
straints (|2|i force the expected utility Vi of agent i to be equal 
to the expected utility given by every action ai that is played 
with positive probability by agent i. Constraints (|3]l force 
each probability Xi{ai) to be nonnegative. Constraints (|4|l 
force each probabihty vector x^ to sum to one. 



An SNE l Aumann, 1960[ strengthens the NE concept by 
requiring the strategy profile to be resilient also to multilateral 
deviations by any coalition of agents. That is, in an SNE no 
coalition of agents can deviate in a way that strictly increases 
the expected utility of each member of the coalition, again 
keeping the strategies of the agents outside the coalition fixed. 
So, an SNE combines two notions: an SNE is an NE and it 
is weakly Pareto efficient over the space of all the strategy 
profiles for each possible coalition. Unlike an NE, an SNE is 
not assured to exist even in mixed strategies. 

Multi-objective programming provides Pareto optimal- 
ity conditions fMiettinen, 1999 ], based on Karush-Kuhn- 
Tucker (KKT) results. These conditions are: 

J2^i • V/.(z) + E/ij ■Vgji2.} + J2''k • V?ifc(z) =0 (5) 

i j k 

Mj-Si(z)=0 Vj (6) 

X,,fi,>0 Vj,j (7) 

Y,X. = 1 (8) 

where /i(z) are the objective functions to minimize, gj{z) 
are inequality constraints as gj{z) < 0, and hk are equality 
constraints as hk (z) =0. The A^ , Hj , Vk are called KKT mul- 
tipliers; \i is the weight of objective function fi, jjlj is the 
weight of constraint g^, and hk is the weight of constraint hk- 
The KKT conditions (S])-® are necessary conditions for 
local Pareto efficiency iMiettin en, 1999[ . For games, we can 
map these conditions to the case of Pareto efficiency for a 
single coalition C C iV as follows: 

• fi is agent j's expected utility multiplied by ' — 1' (given 
that in KKT the objective fi is to minimize); 

• gj is a constraint of the form —Xi{ai) < 0; 

• hk is a constraint of the form J^a-eA- ^ii^i) ~ 1 = 0. 

3 Characterization of mixed-strategy SNEs 

We study the properties of mixed-strategy SNEs. We focus 
on the basic case of 2-agent games and we discuss how the 
reasoning can be extended to games with 3 or more agents. 

We denote by Pmix and by Pcor the sets of points in the 
agents' utility spaces E[C/i] x £[1/2] that are on the Pareto 
frontier when the agents play mixed and correlated strategies, 
respectively. Obviously, points in Pcor non-strictly Pareto 
dominate points in Pmix, given that mixed strategies consti- 
tute a subset of correlated strategies. In addition, we denote 
by Pmix{S) and Pcor{S) the Pareto frontiers in mixed and 
correlated strategies, respectively, when the game is restricted 
to the sets of actions in support profile S. 
Theorem 3.1 Consider a non-degenerate 2-agent game 
with two actions per agent. If there is a mixed-strategy SNE, 

tnen rniix — ^coT' 

Proof. We can write down the game as follows: 

agent 2 
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as 


34 


c ai 


Pi,"?! 


P2,q2 


M 32 


P3,g3 


P4,g4 



By assumption: 
• There is a mixed-strategy NE. Therefore: 

2:2(33) • Pl + 2:2(34) ■ P2 = 2:2(33) • P3 + 2:2(34) • P4 (9) 

2:1(31) • gi + 2:1(32) • 93 = 2:1(31) • 132 + 2:1(33) • 94 (10) 



• The NE is on Pmix, being an SNE. Therefore, the KKT 
conditions are satisfied (since they are necessary condi- 
tions for local weak Pareto efficiency): 

-Ai • (3:2(33) • pi + 2:2(34) • P2)- 

-A2 • (2:2(33) • gi + 2:2(34) • 92) = 1^1 (11) 
-Ai • (2:2(33) • P3 + 2:2(34) • P4)- 

-A2 • (2:2(33) ■ 93 + 2:2(34) • 94) = !^i (12) 
-Ai • (2:1(31) • pi + 2:1(33) • P3)- 

-A2 ■ (2:1(31) • (Ji + 2:1(33) • 53) = U2 (13) 

-Ai • (2:1(31) • P2 + 2:1(32) • P4)- 

-A2 • (2:1(31) • 52 + 2:1(33) • 54) = 1/2 (14) 

By combining (|9]l, ( fTOl i with (fTB-lflU). we obtain 

2:2(33) • gi + 2:2(34) • 92 = 2:2(33) • qs + 2:2(34) • 134 (15) 

2:1(31) • pi + Xi(32) • P3 = 2:1(31) • P2 + 2:1(32) • P4 (16) 

By trivial mathematics, we can rewrite (|9), (ITOi , (llSt , (fT&i as 

2:2(33) • (Pl - Ps) = 22(34) • (p4 - P2) 

2:1(31) • (gi - 52) = 21(32) • (94 - 93) 

2:2(33) • (qi - qs) = 2:2(34) • (94 - ?2) 

2:1(31) • (pi - P2) = 21(32) ■ (p4 - ps) 

We can safely assume pi ^ p^, p2 ^ Pi, Pi ^ P2, Pa ¥" Pi, 
and the analogous inequalities for agent 2, since this assump- 
tion excludes only degenerate games. Indeed, if pi = pa, 
then, by the above conditions, we have p2 = Pi, and there- 
fore actions ai and 82 are the same; if pi = p2, then, by the 
above conditions, we have p^ = p4, and therefore, in order 
to have a mixed-strategy NE, we need pi = P2 = Ps = Pi- 
The same reasoning holds for agent 2. Thus, we derive the 
following conditions: 

Pl - P2 _ qi ~ ?2 Pl - P3 _ gi - 93 

P4 — P3 94 — 93 P4 — P2 94 — 92 

We can give a simple geometric interpretation of the above 
conditions. Call i?; = {pi,qi). Each i?i is a point in the space 

E[t/i] X E[C/2]. The above conditions state that: 
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• i?i_R2 is parallel to i?3i?4, 

• i?i-R3 is parallel to i?2^4, 

and therefore i?i, i?2, ^3, R4 are the vertices of a parallelo- 
gram, see Fig.lifa)- Given that 

• a mixed-strategy NE is strictly inside the parallelogram 
(it being the convex (non-degenerate) combination of 
the vertices), see Fig. \lia), and that 

• it must be on a Pareto efficient edge (since, if it is 
strictly inside the parallelogram — as in Fig. [TJa) — then 
it is Pareto dominated by some point on some edge), 

we have that i?i, i?2i ^3j R4 niust be aligned according to a 
line of the form E[Ui] + (j) ■ E[C/2] = const with G (-1, 0), 
see, e.g., Fig.lH^)- Thus, the combination of i?i, i?2, i?3, Ri 
through every mixed-strategy profile lies on the line con- 
necting the two extreme vertices; for example, in Fig. [TJfe) 
the extreme vertices are R2 and i?i . It trivially follows that 
P — P n 

^ mix — ^ cor- I — I 

The proof of the above theorem provides necessary condi- 
tions for a game to admit a mixed-strategy SNE. These con- 
ditions are not sufficient. Indeed, we can show that only some 
alignments of i?i , i?2 , ^3 , Ri can lead to an SNE: 
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(112 3 4 5 12 3 4 5 

E|r/il E[r/i] 

(«) {b) 

Figure 1: Examples used in the proof of Theorem |3 . 1 1 

Corollary 3.2 The only alignments of Ri, R2, R3, Ri that 
can lead to an SNE satisfy the following conditions: 

• i?i or i?4 is one extreme, 

• moving from the previous extreme, the next vertex is Ri 
or Ri, 

• the next vertex is R2 or R3, 

• i?3 or i?2 is the other extreme. 

Proof We initially show that it is not possible to have a 
mixed-strategy NE for alignments different from those con- 
sidered in the corollary. For reasons of space, we study a 
single case, the proof in the other cases is similar Con- 
sider, for contradiction, the case in which i?i is the extreme 
with the maximum E[C/i], then the sequence is R2, R3, and 
R4. It can be observed that the first action of the first agent 
dominates the second action because Ui{Ri) > Ui{Rj,) 
and C/i(i?2) > Ui{Ri) and therefore the first agent will 
play the first action with probability one. So, there is no 
mixed-strategy NE. Instead, for the alignments considered 
in the corollary, dominance does not apply, as shown, e.g., in 
Fig.E] D 
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Figure 2: Example 2-agent game (left) and its Pareto frontier 
(right). 

We now extend the previous result to the setting in which 
each agent has m actions and l^il = |S'2| =2. 
Corollary 3.3 Consider a non-degenerate 2-agent game 
with m actions per agent. If there is a mixed-strategy SNE 
with support sizes \Si\ = \S2\ — % then Pmix{Si,S2) = 

Pcor{Sl, S2). 

Proof We can spUt the NE constraints and KKT conditions 
into two groups: those generated considering deviations to- 
wards pure or mixed strategies over the supports Si and S2 
and those generated considering deviations towards pure or 
mixed strategies over actions off the supports 5*1 and 5*2 . The 
constraints belonging to the first group are the same as in the 
case with two actions per agent considered in the proof of 
Theorem 13.11 The second group overconstrains the problem 
and it is not necessary for the proof. Thus, restricting the 
game to the actions in Si and 6*2, Theorem 13. II holds and 
therefore F™„(5i, Sa) = PcoASi, S2), see, e.g., Fig.O D 
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Figure 3: Example 2-agent game (left) and its Pareto frontier 
(right). 

Next we study the case of arbitrary-sized (potentially de- 
generate) games admitting SNEs with full supports. 
Theorem 3.4 Consider a 2-agent game with toi and m2- If 
there is a mixed-strategy SNE with \Si\ = mi and \S2\ — 

TTl2} men ±rnix — ^cor- 

Proof sketch. The proof is similar to the proof of Theo- 
remO Define i?jj = (t/i(i,j), 1/2(1, j))- By NE con- 
straints and KKT conditions, we have that 

• for all i, ^^, xi{ai) ■ Rij = const (i.e., the convex 
combinations of the elements of each column of the bi- 
matrix must have the same value), and 

• for all i, J2a -^2(0^) • Rij — const (i.e., the convex 
combinations of the elements of each column of the bi- 
matrix must have the same value), 

and we have that 

• each convex combination is strictly inside the polygon 
whose vertices are points Rij (because the combination 
is not degenerate), and 

• the combination must be on a Pareto efficient edge (oth- 
erwise it would be Pareto dominated), 

and therefore all the vertices must be aligned. In this way, the 
combination of all the points Rij for every mixed strategy 
leads to a point that lies on the line connecting all the Rij. 
Thus we have P,mx = Pcor- □ 

The extension of Corollarv l3.2l to the case with support size 
larger than two is very involved and we omit it here due to 
limited space. Instead, Corollary 13.31 easily extends to the 
case in which the support per agent is larger than two (we 
omit the proof because it is the same as that of Corollary |33). 



Corollary 3.5 Consider a 2-agent game with mi and TO2. If 
there is a mixed-strategy SNE with \Si\ — mi and 1 52 1 = 
rn2, then Pmix{Si,S2) = Pcor(<S'i, S'2). 

We will now discuss how the above results extend to 
more than two agents. For example, in the 3-agent set- 
ting, the vector of payoffs for each action profile is Ri.j^k — 
{Ui{i,j, k), 1/2(1, j, k), 1/3(1, j, k)). The crucial result is that 
necessary conditions, generated for only the actions in the 
supports, for mixed-strategy SNEs forced by NE constraints 
with KKT conditions for all the coalitions (i.e., {1, 2}, {1,3}, 
{2, 3}, {1,2, 3}) require that all the Ri.j^k lie on a plane (with 
n-agent games, all the payoff vectors restricted on S must lie 
on an (n — l)-dimensionalhyperplane). Thus, we have: 
Theorem 3.6 Consider an n-agent game. If there is a 
mixed-strategy SNE with support profile S then Pmix(S) = 

Pcor\^)- 



The above theorem provides only some necessary conditions, 
given that many other conditions, due to, e.g., dominance, are 
required to have mixed-strategy SNEs. Interestingly, we can 
show that there are vectors of payoffs that satisfy all these 
conditions. For example, the following 3-agent game has a 
mixed-strategy SNE in which all the agents randomize with 
uniform probability over all their actions: 
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4 Worst-case 2-agent instances for 
support-enumeration algorithms 

We now leverage the results from the previous section to show 
that it is possible to generate games, with m actions per agent, 
that have only one SNE, and the support size can be set any- 
where in the range {1,..., f^]}. Thus, given m, we can 
generate 0(4^ ) different game instances, each with a differ- 
ent SNE. These game instances are the worst-case instances 
for support-enumeration algorithms, given that, for each pos- 
sible enumeration, it is possible to generate an instance that 
requires the algorithm to scan an exponential number of sup- 
ports. 

We first introduce some results that we subsequently ex- 
ploit to generate our hard instances. 

Corollary 4.1 Given an even number to, consider the fol- 
lowing two-agent game in which each agent has m — 2to 
actions. 



U,.^ 



uf 



1,1 



uf 



1,2 



TJ.k 



where Ui' are matrices m x m defined as follows: 



1 otherwise 



j odd 



Uf-^(i,k) = 



Ul-'^(i,k) = 



~ m if i — j 
otherwise 



1 otherwise 






This game has an SNE with support sizes \Si\ — \S2\ — m. 
and no other SNE. 

Proof Denote by A\ the first to actions of agent i and by 
A^ the second m actions of agent i. For clarity we split the 
proof into two parts, discussed in the following paragraphs, 
respectively. An example game is in Fig.S] 
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Figure 4: Example game that has an SNE with \Si\ = \S2\ = A = m (left), and its Pareto frontier (right). 



There is an SNE with \Si\ — \S2\ — m. The strategy pro- 
file in which each agent i plays all actions in Aj with uniform 
probability = is an SNE. All the actions in the supports, i.e., 
Aj, provide utility i, while all the actions off the supports, 
i.e., A|, provide utility n™^^^'" — _^ Therefore, it is 
an NE. Furthermore, the outcomes with utilities (1,0) and 
(0, 1) are Pareto efficient, and the others are (weakly) domi- 
nated. Thus the Pareto frontier is a line that connects (1, 0) to 
(0, 1); therefore the NE is Pareto efficient. So, it is an SNE. 

There is no other SNE. We focus on the strategy of agent 2 
(the same reasoning can be applied for agent 1). Suppose 
agent 2 adopts a different strategy than the above uniform 
strategy over A^. If agent 2 randomizes over a strict subset 
of A2 composed of only odd actions or only even actions, 
then agent 1 has two best responses, one in A\ and one in A^ 
(each provides agent 1 utility 1). However, there is no NE of 
this form, given that, if agent 1 randomizes over such best re- 
sponses, agent 2's best response would be to play some action 
in A2 with a positive utility in place of a utility of —m given 
by the actions in Aj . If agent 2 randomizes over a strict subset 
of Al with even and odd actions, then agent 1 has one or more 
best responses in Af that provide utility 1 to agent 1. Also 
in this case, if agent 1 randomizes over such best responses, 
agent 2 would play some actions in A^ gaining in place of 
— m given by actions in A2. If agent 2 randomizes over less 
than m actions in A^ and A|, then agent I's best response is 
to play some action in Af. Also in this case agent 2's best 
response would be to play some action in A^. Finally, when 
both agents play only actions in Af or play more than to ac- 
tions, we can have NEs, but these NEs are Pareto dominated 
(because they are randomizations over Pareto-dominated out- 
comes). D 

Games with m odd are a simple variation w.rt. the even 
case (the proof is omitted being very similar): 
Corollary 4.2 Given an odd number rn, consider the follow- 
ing two-agent game in which each agent has m — 2to ac- 
tions. 



U, 



uy u 



1,2 



u 
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where U\ 

rl,2 



j,k 



are matrices m x m defined as follows: 



r2,l 



t2,2 



C/j ' , f/j ' , U^' are generated as in the case ofm even, 



rl.l 



[/j ' are composed of a submatrix (to — 1) x (to — 1) 
generated as in the case of rn even and all the other 
entries are i. 



This game has an SNE with support sizes \Si\ — \S2\ — rn 
and no other SNE. 

We are now ready to define our hard-to-solve instances. 

Definition 4.3 (Hard-to-solve instances) Given rn and to, 

ifm G {2, . . . , [ yJ }, fl hard-to-solve game instance is com- 
posed as follows: 

• a sub-bimatrix of size 2to x 2to built as described in 
Corollaries \4.1\ and \4.2\ 

• all the other entries are drawn from {—to. . . , 0} with 
uniform probability. 

Ifm—l, all the entries are drawn from {—m. . . ,0} with 
uniform probability except for a pure action profile in which 
both agents have a utility ofl. 

Theorem 4.4 Hard-to-solve instances admit only one SNE. 
Proof sketch. The SNE described in Corollaries 14. 1 l and 14.21 
is still an SNE because all the additional entries are smaller 
than the expected utility of the SNE. Because these additional 
entries are Pareto dominated, no additional SNE exists. D 
We leave open the extension to ?i-agent games. 

5 Smoothed complexity of SNE finding 

Worst-case complexity, being too pessimistic, is often a bad 
indicator of the actual performance of an algorithm, and 
average-case complexity is difficult to determine. A newer 
metric of complexity, called smoothed complexity, has been 
gaining interest in recent years i Blaser and Manthey, 2012 |. 
It studies how the introduction of small perturbations affects 
the worst-case complexity. There might be several models of 
perturbations. By far the most common perturbation models 
are the uniform one and the Gaussian one. 

In the case of the SNE-finding problem, given a perturba- 
tion Va- of magnitude a, these are defined as follows. 

• Uniform perturbation: for each agent i, every entry in 
Ui is subjected to an additive perturbation [~<j, +(t] with 
uniform probability. 

• Gaussian perturbation: for each agent i, every entry in 
Ui is subjected to an additive perturbation [— z, +z] with 
probability ^=e-l'^'(^''=)-^l'/'"'. 

Denote by Ui the perturbed utility matrix. 

We will first present results for the 2-agent setting. In the 
end of this section we show the generaUzation to any number 
of agents. 

The smoothed running time of an algorithm A given a per- 
turbation Va is defined as 



smoothed-* .A 



"C/i,!72~ 



ltA{Ul,U2)\UuU2] 



where i^(C/i, IJ2) is the running time for the games instance 
[U 1^112)- An algorithm has smoothed polynomial time com- 
plexity if for all < cr < 1 there are positive constants 
c, fci , ^2 such that: 

smoothed-t^ = 0(c ■ m'°i • a^''^) 

where m is the size of the game in terms of actions per agent. 

Basically, a problem is in smoothed-T' if it admits a smoothed 

polynomial time algorithm. 

Theorem 5.1 Finding an SNE is in smoothed-V. 

Proof. We provide Algorithm[T] It has three main parts. 

In the first part (Steps 1-3), the algorithm searches for a 
pure-strategy SNE by enumerating all the pure-strategy pro- 
files and verifying whether each strategy profile is an SNE. 
The verification is accomplished by checking whether or not 
NE constraints are satisfied (this can be done in polynomial 
time in m) and by checking whether or not the strategy pro- 
file is on the Pareto frontier (this can be done in polynomial 
time as shown in | |Gatti et al, 2013| ). If an SNE is found, the 
algorithm returns it. The maximum number of iterations in 
the first part of the algorithm is m?. 

In the second part (Steps 4-7), the algorithm verifies 
whether there there are strategy profile of support sizes 1511 + 
5*2! = 3suchthatF,„i^(5i,52) = Pcor{Si,S2)- This can be 
accomplished in time 0{'m?) by checking whether there is a 
line connecting at least three entries of all the sub-bimatrices 
of size 2 X 2. In the affirmative case, the temporary variable 
temp is set true. Otherwise, temp is set false. 

In the third pait (Steps 8-13), if temp is false, the algo- 
rithm returns non— existence, given that, by Theorem 13.41 
there is no mixed-strategy SNE. Otherwise, the algorithm 
enumerates all supports to find mixed-strategy NEs, and for 
each of them the algorithm verifies whether it is an SNE as 
done in Steps 1-3. In the latter case, the algorithm can take 
exponential time as discussed in the previous section. 

Thus, the running time of Algorithm[T]is super-polynomial 
only if it needs to enumerate supports during Steps 8-13 
(this can take exponential time). This happens only when 

Pm^x{SuS2) = Poor {81,82) for SOmC 51,^2 with \8i\ + 

5*21 = 3. Given that the perturbations P^ over all the 
entries of the utility matrices are independent and identi- 
cally distributed, the probability that the perturbed entries 
are aligned as requked by Corollary 3.5 to have SNEs with 
\8i\ — 1 5*2 1 > 1 is zero. Therefore, the smoothed running 
time of Algorithm [T] is polynomial in m and independent of 
a (for both uniform and Gaussian perturbations). D 

The above result shows that, except for a space of the pa- 
rameters with zero measure, games admit only pure-strategy 
SNEs and therefore that verifying the existence of an SNE 
and finding them is computationally easy. Interestingly, the 
instability is due to the combination of NE constraints and 
Pareto efficiency constraints. Indeed, both the problem of 
finding an NE and the problem of finding Pareto efficient 
strategies are not sensitive to perturbations. Thus, while an 
approximate NE can be found by perturbing a game and find- 
ing an NE of the perturbed game (exactly, an NE of an e- 
perturbed game is an 2e-NE of the original game), this is not 
the case with SNE. Indeed, if a game admits only mixed- 
strategy SNEs, once perturbed, it does not admit any SNE. 



Algorithm 1 SNEfinding 


1: 


for all pure-strategy support profiles do 


2: 


if the support profile has an SNE then 


3: 


return the SNE 


4: 


temp <— false 


5: 


for all strategy profiles with 15*1 1 + 15*2 1 = 3 do 


6: 


if payoffs restricted to supports are aligned then 


7: 


temp <— true 


8: 


if not temp then 


9: 


return non-existence 


10: 


else 


11: 


for all support profiles do 


12: 


if the support profile has an SNE then 


13: 


return the SNE 



The above results extend to the setting with any (constant) 
number of agents. As discussed in Section 3, in order to have 
mixed-strategy SNEs with n agents, all the payoffs vectors 
of the actions in the agents' supports must lie on the same 
{n — l)-hyperplane. Thus, if perturbed even with small per- 
turbations, the probability that the payoff vectors satisfy such 
constraints is zero. Therefore, generic game instances (i.e., all 
instances except knife-edge cases) have only pure-strategy 
SNEs (if any). 

6 Conclusions and future research 

Strong Nash equilibrium (SNE) is the most natural solution 
concept for games where agents can form coalitions, i.e., co- 
ordinate their strategies. An SNE is a strategy profile where 
no coalition can deviate in a way that every one of the devi- 
ating agents (strictly) benefits. Given a finite game, a Nash 
equilibrium always exists, but an SNE might not exist. For 
finding an SNE, there has been a shortage of algorithms. Most 
algorithms only find pure-strategy SNEs in special game 
classes. A recent algorithm finds SNEs generally, but only 
in 2-agent games. 

Our central result is that, in order for a game to have at 
least one mixed-strategy (i.e., non-pure-strategy) SNE, the 
agents' payoffs restricted to the agents' supports must, in the 
case of two agents, lie on the same line, and, in the case of n 
agents, lie on an (n — l)-dimensional hyperplane. Leverag- 
ing this result, we provided two contributions. First, we de- 
veloped worst-case game instances for support-enumeration 
algorithms. These instances have only one SNE and the sup- 
port size can be chosen to be of any size — in particular, arbi- 
trarily large. In this way, for each possible enumeration, it is 
possible to generate an instance that requires the algorithm to 
scan an exponential number of supports. Second, we proved 
that, unlike Nash equilibrium, finding an SNE is in smoothed 
polynomial time: generic game instances (i.e., all instances 
except knife-edge cases) have only pure-strategy SNEs. 

In future research we plan to study the computational com- 
plexity of approximating SNE and to design algorithms to 
do so. We also plan to study computational issues related to 
strong correlated equilibrium. This concept should present 
different properties than SNE, e.g., the convexity of the Pareto 
frontier with this solution concept could make the computa- 
tion of an equilibrium easier and could make equilibria not 
sensitive to small perturbations. 
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